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Introduction 

I n May 2008, the National Assessment Program — Literary and Numeraey 
(NAPLAN) (Ministerial Couneil on Edueation, Employment, Training and 
Youth Affairs, MCEETYA, 2008) eondueted nation-wide tests for reading, 
writing, language eonventions, and numeraey. A national assessment 
program of this kind should provide the stimulus for maero-level (systemie) 
analytieal studies and miero-level (individual sehool and/or elass) analyt- 
ieal studies of the data. This paper is eoneerned with the latter type of study 
where numeraey results of Year 9 Queensland students are analysed. The 
paper provides a eritique of the Year 9 numeraey test, ways in whieh 
students responded to test questions, and how results might inform 
teaehing mathematies. 

The Federal Government wishes to ensure that all students aehieve 
minimum standards in numeraey: band 2 by Year 3; band 4 by Year 5; band 
5 by Year 7; and band 6 by Year 9. Henee, the establishment of a nation- 
wide seale of student aehievement aeross 10 bands that aeeommodate 
different eurrieula aeross different states. It is intended that those students 
who are identified as having aehieved below the minimum standard for their 
year level will be given foeused intervention and additional support. During 
September 2008, individual student reports were delivered to parents, and 
sehools also reeeived sehool reports. The NAPLAN Summary of the National 
Report was released on 12 September by MCEETYA (2008). In order to gain 
a finer grain analysis of error patterns, the results of a single sehool, 
“Suburbia” (pseudonym), are diseussed, sinee the author does not have 
aeeess to state-wide data. Suburbia is an outer suburban sehool with a 
eohort of 100 Year 9 students. The eommunity is relatively eeonomieally 
disadvantaged. The prineipal feeder primary sehools were reported as 
having 61%, 55%, 52% or 44% of students below the national benehmark 
for numeraey in Year 7 (Chileott, 2009). 
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Overview and critique of the 
Year 9 NAPLAN numeracy test 2008 


The test is named a “numeraey test.” Two deseriptors are applied to 
“thinking involving mathematieal ideas:” numeraey and mathematies. 
Van Groenestijn (2002) suggested that numeraey is essentially the appliea- 
tion of mathematies to soeial, personal and work situations. In this artiele, 
numeraey is defined as subset of mathematies, in whieh mathematieal 
knowledge is required to funetion effeetively in soeiety. 

There were two Year 9 NAPLAN tests: the “numeraey non-ealeulator” test 
where students were not permitted to use a ealeulating deviee; and a 
“numeraey ealeulator -allowed” test where students were permitted to use a 
ealeulating deviee. 

Calculator and non-calculator tests 

Eaeh of the 2008 papers eonsisted of 32 questions to be eompleted within 
40 minutes. In reality, only for questions 14 and 22 of the ealeulator - 
allowed paper would the use of a ealeulator be of signifieant assistanee to 
those students possessing reasonable eomputation ability. The remaining 
30 questions on the ealeulator -allowed paper eould be solved with short 
written eomputations or, in some eases, estimation. For example, question 

24 required that 25 be substituted into the equation E = 2T^ where Tis 25. 
Students with arithmetie eompeteney ean multiply 25 by 25 (= 625) and 
double that (= 1250). A ealeulator saves time but is not neeessary for 
students who ean multiply two-digit numbers. 

An area of mathematies where a ealeulator might be expeeted to be of 
assistanee is with eomputations involving fraetions, deeimals, and large or 
many numbers. An analysis of the ealeulator -allowed paper shows that 
many sueh questions ean be easily solved using simple written algorithms 
or mental eomputation. Two examples follow. 

Question 5 in the paper required students to find the number exaetly 
half way between 1 \ and 3 1. Four ehoiees were given. One way of doing this 
question is to do a mixed number subtraetion. An alternative method is to 
plaee both mixed numbers on a number line together with the multiple 
ehoiee options and either eount out the quarters, separating eaeh number, 
or estimate whieh option is half way. If a student were to use a ealeulator, 
they would have to eonvert eaeh mixed number to a deeimal, do the 
subtraetion of deeimals and then eonvert baek to a mixed number. Henee, 
the availability of a ealeulator would do little to simplify the problem. 

In question 9, students were given the information that there were “14 
students in Rina’s elass on Wednesday. The other 1 1 were absent.” They 
were asked, “What pereentage of Rina’s elass was absent?” The solution 
involves finding the total enrolment by adding 11 and 14 to give 25, then 
expressing the fraetion H as a pereentage. The ehoiee by the item writer of 

25 as the denominator obviates any need for the ealeulator, sinee the erit- 
ieal part of the question is to find the denominator. If students used a 
ealeulator, they would have to eonvert 0.44 to a pereentage, a task no 
simpler than doing the problem mentally by multiplying both 25 and 11 by 4. 

With few exeeptions, numbers involved in almost all questions in the 
ealeulator -allowed paper indieated that the authors had ehosen numbers to 
faeilitate simple mental or written eomputations. The eomparable means 
and standard deviations of the test results from both the ealeulator -allowed 
and the non-ealeulator tests for this sehool, as well as an analysis of 
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demands of the questions (no-ealeulator-use mean = 1 1.51, SD = 5.21; and 
ealeulator -use mean = 11.43, SD 5.16), indieated that removing error 
patterns assoeiated with eomputation by giving students a ealeulator had 
no effeet on improving their outeomes. The most likely explanation of these 
data is that if students did not know the underlying strueture, having a 
ealeulator did not help them solve the problem. Indeed, the presenee of the 
ealeulator may have hindered the performanee of some students, if, as so 
often is the ease, the presenee of a ealeulator eneouraged students to rush 
to eomputation before eonsidering the strueture of the question. 

Multiple-choice formats 

The main format was multiple -ehoiee. Only five of the 32 questions on the 
ealeulator -allowed test required written answers (questions 23, 24, 29, 30 
and 31). Nine questions on the non-ealeulator exam required a written 
answer (questions 4, 7, 16, 18, 19, 20, 23, 29, 32). Over the two tests, about 
78% of the questions were multiple -ehoiee, with four ehoiees, and henee 
subjeet to students’ guessing. Over both papers, guessing might aeeount for 
about 20% of the eorreet answers. 

Students eould also obtain eorreet answers without neeessarily under- 
standing the mathematies in the question, partieularly for algebra-based 
questions. For example, question 11 in the non-ealeulator test asked 
students to solve 3x - 5 = x + 1 . This question eannot be solved with “baek- 
traeking,” whieh is a numerieal rather than an algebraie method. Sueh 
questions are generally regarded as a good test of a student’s ability to solve 
for an unknown. However, in a multiple-ehoiee format, students ean obtain 
the eorreet answer through simple substitution of eaeh distraeter. In the 
multiple ehoiee format, student sueeess in Queensland was 57%. In the 
same paper, question 23 has the same strueture: “Find the value of b in this 
equation: 5b-4 = 2b + 17.” The sueeess rate over the State was 29%. The 
inferenee is that the almost-double sueeess rate seen in question 1 1 was 
due to students substituting the distraeters, or guessing. 

Time limits 

Students were expeeted to eomplete eaeh paper in two separate sessions of 
40 minutes duration. This allowed an average of 1 1 minutes for eaeh ques- 
tion. Many of the questions would take most students several minutes to 
read and analyse. Table 1 indieates that fewer students were sueeessful on 
the later questions. Possible reasons are that either students experieneed 
inereasing diffieulties with the later questions and/or they rushed to 
eomplete eaeh paper in the time alloeated. The implieation of this finding is 
that not only do students need to know the material, but must also be profi- 
eient in earrying out tasks rapidly. 

Strand coverage 

NAPLAN eategorises the test items into four strands with approximately 
equal numbers of questions in eaeh strand: 

1 . Number, eight questions on eaeh paper, 25% of the total; 

2. Algebra: funetions and patterns, eight questions on eaeh paper, 25% 
of the total; 

3. Measurement, Chance and Data: eight questions in the non-ealeulator 
test and seven questions in the ealeulator -allowed test, 23% of the total; 


28 


amt 65 (4) 2009 


4. Space: eight questions in the non-ealeulator test and nine questions 
in the ealeulator -allowed test, 27% of the total. 

The almost identieal strand eoverage and the similar strueture of the test 
items further undermine the rationale for two tests. 

The ehoiee of strand eontent in the papers differs from the eontent iden- 
tified by some States; for example, the Queensland Studies Authority (QSA, 
2004) has five strands: Number; Patterns and Algebra; Measurement; 
Chanee and Data; and finally, Spaee. The NSW syllabus (Board of Studies, 
2002) has five strands: Number; Patterns and Algebra; Data; Measurement; 
Spaee and Geometry. In NSW, Chanee is subsumed under Number. 
NAPLAN plaees Chanee with Data and Measurement. By way of interna- 
tional eomparison, the TIMSS (Thomson, 2006) international tests use 
strands of: Number; Algebra; Measurement; Geometry; and Data. 

The basis of the NAPLAN elassifieation is by eontext; for example, non- 
ealeulator paper question 1 , whieh is elassified as Number, shows students 
a sequenee of a briek wall and a table of ordered pairs. Students are asked 
to ealeulate the number of brieks in the next pattern. Sinee this task 
involves reeognising a growing pattern and extending that pattern, it eould 
be elassified in the Algebra strand beeause, while the eontext is Number, 
the proeess of extending a pattern is essentially an algebraie aetivity. 
Similarly, question 8 on the same test is elassified by NAPLAN as being in 
the Spaee strand sinee it involves a square with area to be sealed. The same 
question eould be elassified as proportional reasoning within the Number 
strand, sinee the erux of the question demands an understanding of seale 
and ratio, irrespeetive of the eontext of Spaee. Alternatively, sinee there are 
measurement units involved, this question might be elassified as belonging 
in a Measurement strand. 

A further example of the diffieulty in elassifying questions is seen in 
question 11 of the non-ealeulator paper. To eomplete this question, 
students need to know that all sides of a square are equal in length in order 
to form the equation 3x - 5 = x + 1 . Sinee the geometrie eomponent is rela- 
tively simple, sueh a question would be said to primarily test Algebra, and 
NAPLAN elassifies it as sueh. In some questions, it is less elear whieh sub- 
eomponent of the respeetive questions students would find diffieult, and 
this observation has eneouraged me to put forward an alternative elassifi- 
eation whieh is seen in Table 1 and deseribed below. 


Table 1 , Summary of strand information on 2008 NAPLAN calculator-allowed 
and no-calculator-allowed tests oombined. 


Strand 

% of test 

Number of 
guestions 

Number: Fraction and percentages reasoning 

12,5% 

8 

Number: Proportional reasoning 

ir/o 

7 

Other number (e.g,, decimals, index, and chance) 
reasoning 

8% 

5 

Algebraic reasoning 

28% 

18 

Geometry and geometric reasoning 

25% 

16 

Measurement based reasoning 

9% 

6 

Data-based reasoning 

6.25% 

4 

Total number of guestions over both tests 

100% 

64 
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From the table it ean be noted that there were eight questions based on 
fraetions or pereentages, approximately 12.5% of the test. 

Based on the above analysis of the 64 questions eomprising the 
numeraey tests, Table 1 indieates that 31% (n = 8 + 7 + 5 = 20) of questions 
are Number, 28% (n = 18) are based on algebraie reasoning, 25% (n = 16) 
are assoeiated with geometrie reasoning and only six questions relate to 
Measurement and four to data-based reasoning. This split is similar to the 
Year 8 TIMSS test (Thompson, 2006): Number 28%; Algebra, 25%; 
Geometry 15%; Measurement 15%; and Data 16%. 

Almost all the questions assoeiated with algebra and geometry in the 
NAPLAN tests eannot be eompleted without a good understanding of 
number eomputation, most of whieh is assoeiated with multiplieative 
thinking. 


An analysis of Suburbia’s performance 

The reeently released report A Shared Challenge: Improving Literacg, 
Numeracy and Science Learning in Queensland Primary Schools (Masters, 
2009) indieates that there are ehallenges assoeiated with the teaehing of 
mathematies in all States, ineluding Queensland. This analysis of 
Suburbia’s performanee informs State eurrieulum design. 

Suburbia’s results provide an opportunity to examine error patterns in 
the absenee of state-wide data. The results are first examined by eomparing 
student performanee on the numeraey test to others in the State and nation 
aeeording to the NAPLAN banding system (Table 2). The banding eonversion 
weights harder questions more heavily. 


Table 2. Proportional achievement of sample school, State and nation by band. 


Band 

Suburbia % 

Qld % 

National % 

Band 10 

1.2 

4.3 

8 

Band 9 

0 

12,3 

14 

Band 8 

17.6 

25.2 

25 

Band 7 

25,9 

30,2 

28 

Band 6 

35.3 

20.2 

18 

Band 5 or less 

20 

6.6 

5 


Band 6 is considered the national minimum standard for Year 9. It is 
clear that Suburbia’s scores are below the State average in numeracy. The 
level of numeracy at Suburbia, while below Queensland averages, might be 
representative of a significant proportion of the State’s — and indeed the 
nation’s — children. At Suburbia, about one in three students performed at 
or above the State mean, and about two in three below the State mean. 
Notably, few students excelled, with only about 19% of Year 9 students 
achieving Band 8 or better, compared to 42% for the State and 47% for the 
nation. Conversely, 55% of the school scored at or below the minimum stan- 
dard of Band 6 compared to 27% for Queensland and 23% for the nation. 
This lack of representation of students achieving well and/or at a satisfac- 
tory level, and a prevalence of those in the lower bands, is reflected in a 
school mean of 527 compared to the State mean of 573 and a national mean 
of 582 (scaled scores). 
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Gender, streaming and Indigenous issues 


School NAPLAN reports indicate that 42% of boys and 61% of girls scored 
at or above the State mean. It is likely that these are educationally signifi- 
cant gender differences. It is beyond the scope of this paper to examine the 
gender differences except to note that girls have demonstrated a higher 
achievement level than the boys, a reversal of earlier findings. A consider- 
able body of literature exists on this topic (e.g., Ethington, 1992; Fennema, 
1996; Maccoby <& Jacklin, 1994). 

Of the 98 students enrolled at Suburbia, seven were Indigenous. One 
Indigenous student had an overall score above the school mean, one at the 
school mean and the remaining four had overall scores below the school 
mean (Indigenous mean = 495; school mean = 527). Interestingly, students 
classified as having a language background other than English (LBOTE) 
may be over-represented with scores above the school mean (LBOTE mean 
= 538 compared with school mean of 527). The small sample sizes samples 
and the clumping of the data about the mean suggests caution should be 
exercised before any speculation as to the educational significance of this 
finding is attempted. 

Analysis of the class results indicated that there were very clear differ- 
ences between test performances of the classes within the school. The 
school’s Head of Department (HOD) of Mathematics confirmed that the 
school had a policy of streaming students in Year 9. 

While the overall school achievement indicates challenges, it is worth 
determining if students obtained relatively better scores in particular 
strands. These findings are shown in Table 3, and indicate that students 
were challenged across all strands. 


Table 3, Student achievement in strands. 


Strand 

Mean 

SD 

% Correct 

Number: Fraction and percentages reasoning 

2,98/8 

1,93 

(37%) 

Number: Proportional reasoning 

2,07/7 

1,67 

(30%) 

Other number (e.g., decimals, index, and chance) reasoning 

1,71/5 

1,36 

(34%) 

Algebraic reasoning 

5,38/18 

3,24 

(29%) 

Geometry and geometric reasoning 

6,19/16 

3,57 

(38%) 

Measurement-based reasoning 

1,57/6 

2,07 

(26%) 

Data-based reasoning 

1,52/4 

1,03 

(38%) 


A more detailed summary of the relative performance of students who 
answered each question correctly is shown in Table 4. In Table 4, the 
percentage of students in the school who answered each question correctly 
is compared with the percentage of all students who answered the question 
correctly in Queensland. The relative difference in correct response is in 
brackets. The national strand is indicated by the letter beside the question 
number. For example, “4 m” means question 4, NAPLAN classification 
Measurement. 

With regard to the Number strand, only 49% of students could recognise 
that 11/4 is equivalent to 2|. The concept of fractions is introduced in 
Year 4. Similarly, only 8% of students in Year 9 at Suburbia school and 19% 
of the State’s Year 9 students succeeded with the problem; 6.6 0.3 = 22 

(question 21 on the non-calculator test). Question 7 on the non-calculator 
paper asked students to calculate how many US dollars could be purchased 
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Table 4. Categorisation and student performance on individual questions. 
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if they had 50 Australian dollars, and AUSl buys USS0.80. Only 43% of the 
sehool and 53% of the State managed to eompute the eorreet answer. These 
suggetexamples indieate the ehallenges students faee in the learning of 
fraetions, pereent, and proportional reasoning. 

Students also struggled with Algebra; for example, the eorreet response 
rate to question 23 (What is the value of b in this equation? 5b-4 = 2b+17, 
non-multiple-ehoiee) was 8% for the sehool and 29% for the State. Students 
also experieneed diffieulty with substitution, with 25% eorreet when substi- 
tuting with an exponent; 33% eorreet when “3” was substituted with the 
unknown variable oeeurring in both the numerator and denominator of an 
expression; and 12% eorreet when the substituted number was a deeimal 
(3.75), even when a ealeulator was at hand. 

In the Geometry strand, results were similar to other strands. Only 38% 
of the students eorreetly answered the multiple-ehoiee question where they 
were required to find an unknown angle in a triangle, given that one angle 
was 35° and the other a right angle (indieated by the eonventional symbol). 
The few questions in whieh most students did aehieve satisfaetory results 
were those to whieh students in the middle primary years might be expeeted 
to give eorreet responses; simple sjanmetry, 81% eorreet (question 7); and 
reasoning with nets, 75% eorreet (question 6, both in the ealeulator -allowed 
paper). 

One question was relatively well done in the Measurement strand; 46% 
for the sehool (1% above the State) sueeeeded in finding the hours and 
minutes between 3.27 am and 2.16 pm (question 19, multiple-ehoiee in the 
ealeulator -allowed paper). Eneouragingly, the Year 9 NAPLAN results in 
2008 showed that 58% of Suburbia students eorreetly answered a stem and 
leaf question (5% above the State average) and 25% eorreetly identified the 
eorreet response in a multiple-ehoiee question on mean and mode. 


Discussion 

Implications for test writers 

The similarity of balanee of Strands, strueture of questions, and, in partie- 
ular, the use of relatively simple numbers in the ealeulator -allowed test 
suggest that there is an argument for having one non-ealeulator -allowed 
test, rather than two separate tests. There is little evidenee that removing 
error patterns in eomputation proeesses by allowing the use of ealeulators 
advantaged students. 

Well-eonstrueted multiple-ehoiee questions have been reported to be 
highly reliable in assessing student eompeteney, ineluding mathematies 
(e.g., Bridgemen, 1991; Hopkins, George & Williams, 1985). Noreini, 
Swanson, Grosso and Webster (2009) found that written solutions to 
patient-management problems and multiple-ehoiee responses in the same 
domain essentially measured the same thing. On the other hand, Berg and 
Smith (2006), in their study of students’ abilities to eonstruet and interpret 
line graphs, found that multiple-ehoiee and free-response instruments 
showed signlfieant diserepaneies. These authors eoneluded that in some 
instanees, multiple-ehoiee questions were not a valid measure of abilities 
(Berg & Smith, 2006). 

Analysis of the 2008 Year 9 NAPLAN results indieates that the predomi- 
nanee of multiple-ehoiee formats added an element of variability to the test 
whieh beeame inereasingly important among students who struggled with 
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mathematics. Guessing or substitution could account for about 60% of the 
marks of a middle-performing student at the school, and, in some cases, for 
all of the marks. The effect of multiple-choice questions in inflating achieve- 
ment marks was seen on those questions where students performed 
relatively poorly on questions which required them to write an answer, 
compared to similarly structured questions where there was a multiple- 
choice option. 

The classification of questions by NAPLAN according to context rather 
than the critical thinking required to answer the questions has implications 
for teaching allocated to particular mathematics strands. The NAPLAN clas- 
sification suggests that 16 questions are Number; it could be argued that 
20 questions are Number. There are also inconsistencies between the way 
that NAPLAN and different States classify the strands. These differences 
might affect the allocation of time for the study of particular topic domains. 
This is particularly important for questions that essentially involve frac- 
tional thinking (fractions, decimals, proportion, and percent). By classifying 
questions as Measurement rather than Number questions (e.g., 9, 10, 18, 
20 and 24 on the non- calculator test), the true extent of the importance of 
fractional thinking is obscured. 

Implications of the test results for Suburbia's work program 

The results of this paper indicate that there needs to be an emphasis on 
teaching the fundamental concepts of mathematics. This consideration may 
be particularly important given the context of the school, which has inher- 
ited mathematically-disadvantaged students from primary feeder schools. 
The data indicate a need to focus on the students’ learning basic number 
facts, mental strategies and algorithms for fractions, percent, and decimals, 
rates and ratio, linear algebra, and plane geometry for about 75% of the 
learning time. An analysis of Suburbia’s work program below illustrates 
that there is a mismatch between the study time allocated to particular 
strands and the test weighting for these strands. 

The benchmark levels in the “Junior Mathematics Work Program” of 
Suburbia are consistent with the Mathematics Years 1 to 10 Syllabus (QSA, 
2004) and the Essential Learnings curriculum (QSA, 2007). Neither of these 
documents suggests the proportion of learning time to be spent on partic- 
ular concepts. This has implications for Suburbia’s programs for Year 8 and 
9, which are analysed below. 

The school’s work program defined “numeracy” as: “Numeracy within the 
mathematics classroom is identifying the mathematics in a context relevant 
to the student” (Suburbia Work Program, 2008, p. 7). Consistent with this 
definition, the program was organised about integrated projects, each of five 
weeks’ duration. The projects are briefly described below. However, only the 
first two units of the Year 9 program are described, since the NAPLAN tests 
are conducted in early May and subsequent work becomes irrelevant to 
student performance. 

Number -learning underpins each of the domains shown in Table 5 and 
the projects offered opportunities for students to learn critical number 
concepts. However, there is a lack of alignment with the weighting of 
NAPLAN tests; for example, the data project represents 10% of Year 8 and 
9 study, but 6.5% of the NAPLAN tests. Geometry and measurement 
projects (Units 3, 5, 6 and 7) take up almost half of the learning time but 
are 34% of NAPLAN questions. Algebra projects occupy 20% of Year 8 and 
9 learning time but 28% of the NAPLAN test. This disjunction in terms of 
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Table 5. Suburbia's Year 8 and 9 Work Pragram, 


Unit (all durations 5 weeks) 

Key domains 

Year 8 

1 , What does the school 
think about? 

Data collectian and display 

2, Fundraising for a charity 

Computations in financial contexts some algebra 

3, Inside a beehive 

Aspects of number, measurement, and geametry 

4, Chance 

Chance 

5, Time and lacation 

Measurement af time and geametry in mapping 
contexts 

6, Designing a cantainer 

Measurement and geometry 

7, Forensics 

Geometry and measurement 

8, Linear functions 

Algebra; introductian to variables, expressians and 
salving linear equations. 

Year 9 

1 , Measurement 

Perimeter and area 

2, Linear equations 

Algebra: writing, graphing and salving linear equatians 


the time alloeated is, however, relevant to the needs of the students who 
eome to the sehool. 

As noted earlier, the feeder sehools have high proportions of students 
elassified as being below the national numeraey benehmark (44% to 61%, 
Chileott, 2009). The Year 9 results for 2008 indieate that the sehool has 
been unable to remediate the laek of knowledge of basie skills of students 
from the feeder sehools. In late 2008 it was debated among mathematies 
Heads of Department in the distriet whether the Year 8 and Year 9 work 
programs ought to foeus on developing fundamental number eompeteney. 
The Head of Department of Mathematies at Suburbia explained that most 
of the students were “so disengaged that [he was] very reluetant to ehange 
to a more formal, and potentially less eontextual, and thus less engaging, 
program.” In the eontext of many students’ prior mathematies learning, 
attempts to take aeeount of students’ attitude are understandable. 

Suburbia’s work program eontains statements about pedagogy based 
upon assumptions about how students learn. It refleets the philosophy and 
reeommendations suggested by the State syllabus doeuments whieh advise 
that students should beeome “aetive investigators” (QSA, 2004, p. 3), and 
that a “learner eentred approaeh” be adopted (QSA, 2004, p. 10). The sehool 
work program reeommends working by “investigation ... in teams or groups 
working eooperatively and eollaboratively towards shared goals.” Not all 
authors agree that the extensive use of investigations is an effeetive use of 
student learning time (e.g., Kirsehner, Sweller & Clark, 2006). Staeey (2003) 
found that eurrieulum doeuments of some States over the past deeade 
showed less emphasis on eomputational skill and algebra proeedures, but 
a greater emphasis on students obtaining deep understandings of eoneepts 
frequently in eontextual settings. This did not neeessarily translate to 
improved test results. There is, therefore, a danger that too mueh time be 
spent on investigations where a few eoneepts might be explored in depth 
and not enough time spent learning and understanding mathematieal 
struetures and proeesses. 
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Implications of the test results for State- and school-based 
assessment 

In Queensland, sehools write their own assessment items for the majority 
of junior mathematies assessment. In this sehool, half of all assessment in 
Years 8 and 9 foeuses on “extended tasks.” TYpteally, these involve students 
working in groups to investigate aspeets of mathematies in a partieular 
eontext, and writing a report. For example, the 2009 Year 9 task requires 
students to “analyse data to make rainfall predietions and investigate how 
rainfall is measured. They then use loeal rainfall data to ehoose an appro- 
priate storage tank and plan how to make effeetive use of the eolleeted 
water” (QSA, 2009, P. 2). This t 5 qDe of assessment is different from the 
NAPLAN tests and thus it is reeommended that the sehool eonsider some 
alternative assessment formats. 


Concluding remarks 

Analysis of the 2008 NAPLAN tests suggests that further researeh into the 
eategorisation of test items aeeording to strand is warranted. The eurrent 
elassifieation has the effeet of under-representing the importanee of the 
Number strand, partieularly those eoneepts assoeiated with fraetional 
thinking. Error -pattern analysis suggests that there is merit in pursuing 
further researeh in regard to the use of multiple-ehoiee questions. The data 
indieated that this format tended to inflate student marks, partieularly 
among those students with limited mathematieal knowledge. The test 
writers might eonsider the use of additional short answer questions. 

Learning is a eomplex aetivity influeneed by the interaetion of variables 
ineluding: eultural expeetations (e.g., Eeeles et al., 1993; Harrison & 
Huntington, 2000); student attitudes and beliefs (e.g., Ethington, 1992; 
Fennema, 1996; Thomson & Fleming, 2003); teaeher knowledge of subjeet 
and pedagogy (e.g., Staeey & Chiek, 2004; Thomson & Fleming, 2003); 
eurrieulum doeuments, ineluding support material and textbooks (e.g.. 
Groves, Mousley & Forgasz, 2006); and work programs as a manifestation 
of eurrieulum intentions. Of these variables, it is the implementation of the 
work program that is most relevant to this paper. Clearly there is a need for 
synergy between national expeetations as refleeted in NAPLAN tests and 
individual sehool work programs. In this ease, the data indieate a ease for 
greater foeus on teaehing the fundamental eoneepts of Number. There is 
also evidenee that the sehool should explore ways to aeeommodate expee- 
tations of State eurrieulum doeuments and testing proeesses and the 
demands of NAPLAN testing. It is possible that a reduetion in report-writing 
assessment for mathematies is warranted. 

The very poor results of many students in basie faets on the NAPLAN 
tests and the results published by Chileott (2009) indieate that there is a 
need for Suburbia to eollaborate with the primary feeder sehools in regard 
to the development of eritieal Number understanding. A further eonsidera- 
tion is that few seeondary teaehers are trained to teaeh middle primary 
sehool mathematies eoneepts. This suggests that there is a need to eonduet 
professional development for seeondary teaehers on how to diagnose, and 
then remediate, miseoneeptions assoeiated with the middle and upper 
primary sehool Number strand. 

The results of this analysis of one sehool’s 2008 Year 9 NAPLAN report 
has given the sehool a wealth of data on whieh to refleet. The analysis 
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provides background to further investigation in that school. The reflections 
may be of assistance for teachers in other schools who may have similar 
problems and wish to analyse their MCEETYA reports and plan their 
responses to the national testing processes. 
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